Author

Lisa Levoir

Published

November 5, 2023

1 Data import and cleaning

In this section I import the data and prepare it for analysis.

Code
```{r setup}
#| warning: false
#| message: false

library(tidyverse)
library(plotly)
library(dplyr)
library(tidyr)
library(knitr)
library(table1) #Create HTML Tables of Descriptive Statistics https://cran.r-project.org/web/packages/table1/vignettes/table1-examples.html
#library(OMTM1) #https://github.com/schildjs/OMTM1/
library(Hmisc)
library(rms) # Regression Modeling Strategies by Frank https://cran.r-project.org/web/packages/rms/index.html
library(modelsummary) #Summary Tables and Plots for Statistical Models and Data: Beautiful, Customizable, and Publication-Ready https://cran.r-project.org/web/packages/modelsummary/index.html
library(scales) # The scales packages provides the internal scaling infrastructure used by ggplot2, and gives you tools to override the default breaks, labels, transformations and palettes. https://scales.r-lib.org
library(viridis) #colors
library(cowplot) #allows me to use plotgrid
library(gridExtra) #adding tables to plots
library(visdat) #shows missing data
library(GGally) #makes pairs plots
library(sandwich) #for robust standard errors

setwd("/Users/lisalevoir/BIOS7351_Collab/data_project2") #this line I would need to run in the console
knitr::opts_knit$set(root.dir = "/Users/lisalevoir/BIOS7351_Collab/github/BIOS_Collaboration/project_2_analysis") #now I set global options for knitting, I also had to toggle global options > R Markdown > evaluate chunks in current directory


#import the data
dat <- read.csv("/Users/lisalevoir/BIOS7351_Collab/data_project2/combined_data_203.csv")

#to compare that the merging went as expected
VUMSdat <- read.csv("/Users/lisalevoir/BIOS7351_Collab/data_project2/DATA_VUMS.csv")
HMSdat <- read.csv("/Users/lisalevoir/BIOS7351_Collab/data_project2/DATA_HMS.csv")
UVAdat <- read.csv("/Users/lisalevoir/BIOS7351_Collab/data_project2/DATA_UVA.csv")
```

1.0.1 Inclusion/Exclusion

Criteria to exclude students who most likely took a scored exam:

  • Any PhD students (n = 2)

  • Any 5th year program students (n = 19)

  • M4 students at Vanderbilt (n = 5)

  • Students who did not complete either Step survey (n = 2)

  • Students who specifically stated they took a scored Step 1 (n=1)

Based on our criteria we would exclude record IDs:

  • VUSM: 23, 26, 39, 40, 54, 3, 8, 12, 49, 60, 62, 64

  • HMS: 1, 21, 28, 30, 34, 37, 39, 41, 44, 47, 49, 61

  • UVA: 33, 47, 80, 81, 83

[1] "uworld_percent_step1_1" "uworld_percent_step1_2"
[1] "amboss_percent_step1_1" "amboss_percent_step1_2"
[1] "length_step1_1" "length_step1_2"
[1] "practicetest_step1_1" "practicetest_step1_2"
[1] "full_test_practice_step1_1" "full_test_practice_step1_2"
[1] "push_step1_1" "push_step1_2"
[1] "push_practice_test_step1_1" "push_practice_test_step1_2"
[1] "push_nbme_practice_score_step1_1" "push_nbme_practice_score_step1_2"
[1] "push_uw_practice_score_step1_1" "push_uw_practice_score_step1_2"
[1] "final_nbme_practice_score_step1_1" "final_nbme_practice_score_step1_2"
[1] "final_uw_practice_score_step1_1" "final_uw_practice_score_step1_2"
 [1] "resources_step1_1___1" "resources_step1_1___2" "resources_step1_1___3"
 [4] "resources_step1_1___4" "resources_step1_1___5" "resources_step1_1___6"
 [7] "resources_step1_1___7" "resources_step1_1___8" "resources_step1_2___1"
[10] "resources_step1_2___2" "resources_step1_2___3" "resources_step1_2___4"
[13] "resources_step1_2___5" "resources_step1_2___6" "resources_step1_2___7"
[16] "resources_step1_2___8"
[1] "score_step1_1" "score_step1_2"
[1] "other_resources_step1_1" "other_resources_step1_2"
[1] "other_step1_1" "other_step1_2"
[1] "changes_step1_1" "changes_step1_2"
[1] "Above is a list of columns I have combined for you. Hope it looks right!"

Data quality: there are r length(step1_complete$uniqueID) unique individuals included in the step 1 data. Below is a table of their inclusion by school:

Code
kable(table(step1_complete$schoolid))
Var1 Freq
HMS 170
UVa 196
VU 171
[1] "uworld_percent_step2_1" "uworld_percent_step2_2"
[1] "amboss_percent_step2_1" "amboss_percent_step2_2"
[1] "length_step2_1" "length_step2_2"
[1] "practicetest_step2_1" "practicetest_step2_2"
[1] "full_test_practice_step2_1" "full_test_practice_step2_2"
[1] "practice_score_step2_1" "practice_score_step2_2"
[1] "practice_test_step2_1" "practice_test_step2_2"
 [1] "resources_step2_1___1" "resources_step2_1___2" "resources_step2_1___3"
 [4] "resources_step2_1___4" "resources_step2_1___5" "resources_step2_1___6"
 [7] "resources_step2_1___7" "resources_step2_1___8" "resources_step2_2___1"
[10] "resources_step2_2___2" "resources_step2_2___3" "resources_step2_2___4"
[13] "resources_step2_2___5" "resources_step2_2___6" "resources_step2_2___7"
[16] "resources_step2_2___8"
[1] "score_step2_1" "score_step2_2"
[1] "target_score_step2_1" "target_score_step2_2"
[1] "Above is a list of columns I have combined for you. Hope it looks right!"

Notice that unfortunately, we had to drop 138 individuals who did not report a step 2 score. These raw counts and frequencies of people who did not give a step 2 score (and are therefor not eligible for analysis) are listed by institution below.

Code
# describing the missingness
kable(table(drop_these_with_no_outcome$schoolid), caption = "Number of missing Step 2 scores by institution")
Number of missing Step 2 scores by institution
Var1 Freq
HMS 41
UVa 52
VU 45
Code
num <- as.vector(table(drop_these_with_no_outcome$schoolid))
denom <- as.vector(table(step2_complete$schoolid))
nonresponse_freq <- setNames(c(round(num/denom, 3)), c(names(table(step2_complete$schoolid))))
kable(nonresponse_freq, caption = "frequency of missing step 2 scores by instition")
frequency of missing step 2 scores by instition
x
HMS 0.318
UVa 0.361
VU 0.357
Code
######### visually profile missing responses
p1 <- visdat::vis_miss(step1_complete)
p2 <- visdat::vis_miss(step2_complete)

title_gg <- ggdraw() + draw_label("Response missingness for pooled survey results across exam order")
gridded <- plot_grid(p1, p2, label_size = 12, ncol = 2, align = "hv", label_x = 0.5,
          labels = c("Step 1","Step 2"))
plot_grid(title_gg, gridded, nrow = 2, rel_heights = c(0.1, 0.9))

2 Analysis

Note, we plan to use the robust/sandwich variance estimator for regression models. One inclusion criteria is that the outcome variable (“Y”) must be available for a subject to be included in the analysis question (ie. if they did not report a step 2 score, we won’t perform relevant step 2 analysis on them).

We cannot analyze Step 1 since all survey responses reported passing For Step 2 scores, I will perform a linear regression with:

  • Y = Step 2 score
  • X = factor ( 1 = “step 1 first”, 2 = “step 2 first”, 3 = “only step 1”, 4 = “only step 2”)
  • Z = school (need to adjust for this)
Note

still need to use robust se

Code
step2_complete[ ,"order_factor"]  <- factor(step2_complete$exam_order, levels = c(1,2, 3, 4), labels = c("step 1 first", "step 2 first", "only step 1", "only step 2"))
step2_complete[ ,"school_factor"]   <- factor(step2_complete$schoolid, labels = c("HMS", "UVA", "VUMS"))

table(step2_complete$exam_order)

  1   2   4 
214 181   4 
Code
exam_order_mod <- lm(formula = score_step2 ~ order_factor + school_factor, data = step2_complete)
sandwich(exam_order_mod) #this gives the sandwich variance
                         (Intercept) order_factorstep 2 first
(Intercept)                1.6640853             -0.516204082
order_factorstep 2 first  -0.5162041              2.373041881
order_factoronly step 2   -0.8343933              0.515236779
school_factorUVA          -1.6405082             -0.105407382
school_factorVUMS         -1.6593841              0.001934606
                         order_factoronly step 2 school_factorUVA
(Intercept)                          -0.83439325       -1.6405082
order_factorstep 2 first              0.51523678       -0.1054074
order_factoronly step 2               5.94333749        0.8138448
school_factorUVA                      0.81384481        3.0988138
school_factorVUMS                    -0.05159291        1.6533268
                         school_factorVUMS
(Intercept)                   -1.659384076
order_factorstep 2 first       0.001934606
order_factoronly step 2       -0.051592909
school_factorUVA               1.653326776
school_factorVUMS              3.421953971
Code
summary(exam_order_mod) #model summary for reporting

Call:
lm(formula = score_step2 ~ order_factor + school_factor, data = step2_complete)

Residuals:
     Min       1Q   Median       3Q      Max 
-112.816   -5.523    3.184    8.377   21.759 

Coefficients:
                         Estimate Std. Error t value Pr(>|t|)    
(Intercept)              261.1405     1.4589 178.992   <2e-16 ***
order_factorstep 2 first  -1.8994     1.4832  -1.281    0.201    
order_factoronly step 2   -6.9279     7.4321  -0.932    0.352    
school_factorUVA           0.3822     1.7843   0.214    0.831    
school_factorVUMS          0.5748     1.8396   0.312    0.755    
---
Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1

Residual standard error: 14.69 on 394 degrees of freedom
Multiple R-squared:  0.00609,   Adjusted R-squared:  -0.004 
F-statistic: 0.6035 on 4 and 394 DF,  p-value: 0.6603

Based on the model output (p values), there doesn’t appear to be any signifigant associations between exam order and the score for Step 2. Since the R^2 value is essentially 0, I conclude that there was no effect of exam order on step 2 scores.

Again, we cannot analyze Step 1 scores since all respondents reported passing.

Based on our SAP, if there are any covariates with more than 30% of responses missing, we will drop that variable or populate it with 0, depending on context. For example, the percent of Amboss questions completed will be filled with 0 for people who didn’t answer since it seems safe to assume they didn’t complete any of the Amboss questions. If less than 30% are missing, I may consider performing bootstrap sampling of known values to replace missing values.

After accounting for missingness, I will assess for co-linearity of the predictors (ie. correlation) using VIF. If there is high co-linearity, we will use LASSO to perform variable selection. If there is no evidence of concerning levels of colinearity, I will proceed with linear regression.

Code
######## profile missingness in the step 2 data and address
percents_missing <- round(colSums(is.na(step2_complete))/nrow(step2_complete), 3)*100
kable(percents_missing, caption = "Percent missing observations for pooled Step 2 survey")
Percent missing observations for pooled Step 2 survey
x
record_id 0.0
schoolid 0.0
exam_order 0.0
uworld_percent_step2 1.5
amboss_percent_step2 75.2
length_step2 1.8
practicetest_step2 0.0
full_test_practice_step2 0.0
practice_score_step2 27.8
practice_test_step2 27.1
resources_step2 0.0
score_step2 0.0
target_score_step2 0.0
order_factor 0.0
school_factor 0.0
Code
#inspecting percent missing, it seems like most responses are now complete except Amboss. Based on our study plan, I will populate those without a response for Amboss with 0's
step2_complete$amboss_percent_step2 <- ifelse(is.na(step2_complete$amboss_percent_step2) == TRUE, 0, step2_complete$amboss_percent_step2)
class(step2_complete$practicetest_step2) <- "integer"

step2_complete[,"on_target"] <-  factor(step2_complete$target_score_step2, levels = c(1,2,3), labels = c("at target", "above target", "below target"))

step2_complete[, "practice_test_2_clean"] <- ifelse(is.na(step2_complete$practicetest_step2) == TRUE, NA, substr(step2_complete$practicetest_step2, start = 1, stop = 1))
step2_complete[, "number_of_practice_tests"] <- as.numeric(step2_complete$practice_test_2_clean)

Multiple linear regression with:

  • Y = Step 2 score

  • X1 = % UWorld

  • X2 = % Amboss

  • X3 = length study

  • X4 = # of practice tests

  • X5 = full test day (yes/no code as binary)

  • X6 = final practice score (however, is there some conversion between U World and Amboss - Jeffrey is looking into this)

  • Z = School (need to adjust for this)

Careful to note that not all cases are complete - for example there are 399 responses in the complete step 2 dataset, of which for the number of practice tests taken, 108 are missing and 291 have a response recorded.

Below I report the model results, sandqich variance, and VIF for step 2 scores model.

Code
step2_complete$simulate_full_practice <- ifelse(step2_complete$full_test_practice_step2 <= 2, 0, 1)
step2_complete$simulate_full_practice <- factor(step2_complete$simulate_full_practice, levels = c(0, 1), labels = c("Yes", "No"))
step2_complete$length_step2 <- factor(step2_complete$length_step2 , levels = c(1:6), labels = c("less than 1 week", "1-2 weeks", "3-4 weeks", "5-6 weeks", "7-8 weeks", "more than 8 weeks"))

mod_step2_scores <- lm(score_step2 ~ uworld_percent_step2 + amboss_percent_step2 + length_step2 + simulate_full_practice + practice_score_step2 + number_of_practice_tests + school_factor, data = step2_complete)
summary(mod_step2_scores)

Call:
lm(formula = score_step2 ~ uworld_percent_step2 + amboss_percent_step2 + 
    length_step2 + simulate_full_practice + practice_score_step2 + 
    number_of_practice_tests + school_factor, data = step2_complete)

Residuals:
     Min       1Q   Median       3Q      Max 
-23.1219  -4.2865   0.4642   6.1259  20.0253 

Coefficients:
                              Estimate Std. Error t value Pr(>|t|)    
(Intercept)                   71.27446    8.74952   8.146 1.73e-14 ***
uworld_percent_step2           0.02004    0.02543   0.788  0.43140    
amboss_percent_step2           0.02941    0.02393   1.229  0.22017    
length_step25-6 weeks          2.14934    1.31507   1.634  0.10342    
length_step27-8 weeks         -3.49155    1.58377  -2.205  0.02838 *  
length_step2more than 8 weeks -8.31483    2.92979  -2.838  0.00491 ** 
simulate_full_practiceNo      -1.19429    1.21770  -0.981  0.32764    
practice_score_step2           0.75231    0.03367  22.347  < 2e-16 ***
number_of_practice_tests      -1.15000    0.40586  -2.833  0.00498 ** 
school_factorUVA               0.60926    1.32227   0.461  0.64536    
school_factorVUMS              0.54129    1.34415   0.403  0.68751    
---
Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1

Residual standard error: 8.751 on 253 degrees of freedom
  (135 observations deleted due to missingness)
Multiple R-squared:  0.7376,    Adjusted R-squared:  0.7273 
F-statistic: 71.13 on 10 and 253 DF,  p-value: < 2.2e-16
Code
sandwich(mod_step2_scores)
                               (Intercept) uworld_percent_step2
(Intercept)                   206.34839819        -4.610501e-02
uworld_percent_step2           -0.04610501         4.557450e-04
amboss_percent_step2            0.06123483         9.443006e-05
length_step25-6 weeks           0.34421876        -1.124014e-03
length_step27-8 weeks           0.08928698         4.041183e-03
length_step2more than 8 weeks  -2.19608507         2.748662e-03
simulate_full_practiceNo       -0.10751818         3.289700e-03
practice_score_step2           -0.77449142        -1.643299e-05
number_of_practice_tests       -0.44564125         1.908165e-03
school_factorUVA               -0.91552244         1.186392e-03
school_factorVUMS              -1.10953794         1.492198e-03
                              amboss_percent_step2 length_step25-6 weeks
(Intercept)                           6.123483e-02           0.344218758
uworld_percent_step2                  9.443006e-05          -0.001124014
amboss_percent_step2                  3.526636e-04          -0.004013648
length_step25-6 weeks                -4.013648e-03           1.138812240
length_step27-8 weeks                -1.175867e-03           0.532328695
length_step2more than 8 weeks         5.741945e-03           0.054506989
simulate_full_practiceNo              2.863869e-03          -0.134680186
practice_score_step2                 -2.738593e-04          -0.001957375
number_of_practice_tests             -8.497351e-04          -0.030590189
school_factorUVA                      1.183388e-03           0.028346410
school_factorVUMS                     8.202325e-04          -0.004085408
                              length_step27-8 weeks
(Intercept)                             0.089286979
uworld_percent_step2                    0.004041183
amboss_percent_step2                   -0.001175867
length_step25-6 weeks                   0.532328695
length_step27-8 weeks                   1.851805100
length_step2more than 8 weeks           0.073353885
simulate_full_practiceNo               -0.085155866
practice_score_step2                   -0.002717006
number_of_practice_tests               -0.033608329
school_factorUVA                        0.086395058
school_factorVUMS                       0.018600707
                              length_step2more than 8 weeks
(Intercept)                                    -2.196085066
uworld_percent_step2                            0.002748662
amboss_percent_step2                            0.005741945
length_step25-6 weeks                           0.054506989
length_step27-8 weeks                           0.073353885
length_step2more than 8 weeks                  19.275872984
simulate_full_practiceNo                        0.921763513
practice_score_step2                            0.003310005
number_of_practice_tests                        0.027106848
school_factorUVA                               -0.230242637
school_factorVUMS                               0.116103365
                              simulate_full_practiceNo practice_score_step2
(Intercept)                               -0.107518175        -7.744914e-01
uworld_percent_step2                       0.003289700        -1.643299e-05
amboss_percent_step2                       0.002863869        -2.738593e-04
length_step25-6 weeks                     -0.134680186        -1.957375e-03
length_step27-8 weeks                     -0.085155866        -2.717006e-03
length_step2more than 8 weeks              0.921763513         3.310005e-03
simulate_full_practiceNo                   1.416072322        -6.174041e-03
practice_score_step2                      -0.006174041         3.053753e-03
number_of_practice_tests                   0.096294705        -1.145722e-03
school_factorUVA                          -0.012093986        -4.027910e-04
school_factorVUMS                          0.005706378         1.451364e-04
                              number_of_practice_tests school_factorUVA
(Intercept)                              -0.4456412514     -0.915522438
uworld_percent_step2                      0.0019081645      0.001186392
amboss_percent_step2                     -0.0008497351      0.001183388
length_step25-6 weeks                    -0.0305901885      0.028346410
length_step27-8 weeks                    -0.0336083291      0.086395058
length_step2more than 8 weeks             0.0271068477     -0.230242637
simulate_full_practiceNo                  0.0962947046     -0.012093986
practice_score_step2                     -0.0011457220     -0.000402791
number_of_practice_tests                  0.1143314303      0.004501388
school_factorUVA                          0.0045013883      1.655558992
school_factorVUMS                         0.0126118087      0.869713472
                              school_factorVUMS
(Intercept)                       -1.1095379352
uworld_percent_step2               0.0014921977
amboss_percent_step2               0.0008202325
length_step25-6 weeks             -0.0040854082
length_step27-8 weeks              0.0186007070
length_step2more than 8 weeks      0.1161033648
simulate_full_practiceNo           0.0057063781
practice_score_step2               0.0001451364
number_of_practice_tests           0.0126118087
school_factorUVA                   0.8697134725
school_factorVUMS                  1.7298916288
Code
vif(mod_step2_scores)
         uworld_percent_step2          amboss_percent_step2 
                     1.066034                      1.082927 
        length_step25-6 weeks         length_step27-8 weeks 
                     1.462849                      1.445249 
length_step2more than 8 weeks      simulate_full_practiceNo 
                     1.385460                      1.087236 
         practice_score_step2      number_of_practice_tests 
                     1.232297                      1.209702 
             school_factorUVA             school_factorVUMS 
                     1.382035                      1.376227 
Code
mod_step2_scores2 <- lm(score_step2 ~ uworld_percent_step2 + amboss_percent_step2 + length_step2 + simulate_full_practice + practice_score_step2 + practice_test_2_clean + school_factor, data = step2_complete)
summary(mod_step2_scores2) #we need to talk about these model results

Call:
lm(formula = score_step2 ~ uworld_percent_step2 + amboss_percent_step2 + 
    length_step2 + simulate_full_practice + practice_score_step2 + 
    practice_test_2_clean + school_factor, data = step2_complete)

Residuals:
     Min       1Q   Median       3Q      Max 
-20.1232  -4.8556   0.6781   5.1994  20.6336 

Coefficients:
                               Estimate Std. Error t value Pr(>|t|)    
(Intercept)                    80.26352    8.77006   9.152  < 2e-16 ***
uworld_percent_step2            0.01690    0.02436   0.694 0.488604    
amboss_percent_step2            0.03798    0.02280   1.666 0.097048 .  
length_step25-6 weeks           1.67818    1.27203   1.319 0.188293    
length_step27-8 weeks          -3.52722    1.49924  -2.353 0.019424 *  
length_step2more than 8 weeks -10.92680    2.91415  -3.750 0.000221 ***
simulate_full_practiceNo       -0.43219    1.15348  -0.375 0.708214    
practice_score_step2            0.72567    0.03309  21.933  < 2e-16 ***
practice_test_2_clean2         -5.28463    4.50934  -1.172 0.242354    
practice_test_2_clean3         -7.72502    3.21759  -2.401 0.017096 *  
practice_test_2_clean4         -3.50624    3.02229  -1.160 0.247117    
practice_test_2_clean5        -11.52642    2.99680  -3.846 0.000153 ***
practice_test_2_clean6         -7.60835    3.12358  -2.436 0.015568 *  
practice_test_2_clean7        -12.08030    3.50384  -3.448 0.000664 ***
practice_test_2_clean8          1.66160    4.86710   0.341 0.733096    
school_factorUVA                0.43736    1.23824   0.353 0.724228    
school_factorVUMS               0.31676    1.25703   0.252 0.801258    
---
Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1

Residual standard error: 8.175 on 247 degrees of freedom
  (135 observations deleted due to missingness)
Multiple R-squared:  0.7764,    Adjusted R-squared:  0.762 
F-statistic: 53.61 on 16 and 247 DF,  p-value: < 2.2e-16

I looked into the difference between practice_test_step2 (the final practice test I took before my exam was… 8 options) and practicetest_step2 (text response of how many practice tests did you take before step 2). I decided not to include either in the model.

Note

We need to talk about the model results between the two ways I coded the variables for # of practice tests

Here, I will perform logistic regression with

Y = yes or no (1 = yes, 2 = no for “push_step1”)

There may not be sufficient data on this since only 20 people responded that they decided to push back Step 1. The factors that were measured are:

  • push remember step1 (1 = I only remember the form name, 2 = I only remember the score, 3 = I remember the form name and the score, 4 = I don’t remember either) - we decided not to include this variable (can change later if desired)

  • push score only step 1 (1 = NBME, 2 = Uworld)

  • push practice test step 1 ( 1 - 8 listing various exams)

  • push nbme practice score (from 0 to 100%)

  • push uw practice score (from 180 to 300)

Listing variables by name and if I have included them:

  • “push_step1_1” yes

  • “push_remember_step1_1” not included b/c a precursor question

  • “push_score_only_step1_1” not currently included but could be

  • “push_practice_test_step1_1” yes

  • “push_nbme_practice_score_step1_1” yes

  • “push_uw_practice_score_step1_1” yes

Code
step1_complete$push_step1 <- ifelse(step1_complete$push_step1 == 2 | is.na(step1_complete$push_step1) ==TRUE, 2, 1) #recording the NA's to be "No" (they did not push back step 1)
step1_complete$push_step1_label <- factor(step1_complete$push_step1, levels = c(1, 2), labels = c("Yes", "No")) #making a nice descriptive label

did_push_df <- step1_complete %>% filter(push_step1_label == "Yes")
dat %>% filter(!is.na(push_remember_step1_1))
     X record_id school           timestamp year exam_order step_spacing
1    9         7   VUSM         2/8/23 9:31    3          1            2
2   12        12   VUSM        2/8/23 10:05    5          1            1
3   23        39   VUSM       2/16/23 20:12    6          1            3
4   29        51   VUSM       2/20/23 12:57    3          1            3
5   47         9   VUSM         2/8/23 9:53    3          3            3
6   50        20   VUSM        2/8/23 11:05    3          1            3
7   60        57   VUSM       2/21/23 10:19    3          3            3
8   75        12 UVASOM 2023-08-17 11:31:21    7          1            2
9  129        67 UVASOM 2023-09-07 09:48:22    7          1            2
10 141        79 UVASOM 2023-09-07 16:02:17    7          1            2
11 174        30    HMS 2023-08-23 18:50:56    4          3            2
12 196        55    HMS 2023-10-04 08:31:07    7          1            2
13 199        58    HMS 2023-10-04 15:27:27    7          1            2
   step_spacing_months survey_complete step_1_first_timestamp
1                   NA               2            2/8/23 9:33
2                   NA               2           2/8/23 10:11
3                    5               2          2/16/23 20:14
4                    3               2          2/20/23 12:59
5                    7               2            2/8/23 9:56
6                    5               2           2/8/23 11:19
7                    6               2          2/21/23 10:26
8                   NA               2    2023-08-17 11:32:55
9                   NA               2    2023-09-07 09:49:48
10                  NA               2    2023-09-07 16:04:58
11                  NA               2    2023-08-23 19:10:48
12                  NA               2    2023-10-04 08:37:24
13                  NA               2    2023-10-04 15:29:01
   resources_step1_1___1 resources_step1_1___2 resources_step1_1___3
1                      1                     1                     0
2                      1                     1                     1
3                      1                     1                     1
4                      1                     1                     1
5                      1                     1                     0
6                      1                     1                     1
7                      0                     0                     1
8                      1                     1                     1
9                      1                     1                     0
10                     1                     1                     0
11                     1                     1                     0
12                     1                     1                     1
13                     1                     1                     0
   resources_step1_1___4 resources_step1_1___5 resources_step1_1___6
1                      0                     0                     0
2                      1                     0                     0
3                      1                     0                     1
4                      1                     0                     1
5                      1                     0                     0
6                      1                     0                     0
7                      1                     0                     0
8                      0                     1                     0
9                      0                     0                     0
10                     0                     0                     0
11                     1                     0                     0
12                     1                     1                     1
13                     0                     0                     0
   resources_step1_1___7 resources_step1_1___8 other_resources_step1_1
1                      0                     0                    <NA>
2                      0                     0                    <NA>
3                      1                     0                    <NA>
4                      0                     0                    <NA>
5                      0                     0                    <NA>
6                      0                     0                    <NA>
7                      0                     0                    <NA>
8                      0                     0                    <NA>
9                      0                     0                    <NA>
10                     0                     0                    <NA>
11                     0                     1                 Osmosis
12                     1                     0                        
13                     0                     0                        
   other_step1_1 uworld_percent_step1_1 uworld_step1_1 first_aid_step1_1
1           <NA>                     NA              3                 1
2           <NA>                     60              3                 1
3           <NA>                     80              1                 1
4           <NA>                     65              1                 1
5           <NA>                     50              1                 1
6           <NA>                     69              1                 1
7           <NA>                     NA             NA                NA
8           <NA>                     75              1                 1
9           <NA>                     70              3                 2
10          <NA>                     35              3                 1
11           Yes                     30              3                 2
12                                   90              3                 1
13                                   86              1                 1
   anki_step1_1 anki_use_step1_1 anki_details_step1_1___1
1            NA               NA                        0
2             1                1                        0
3             1                3                        0
4             1                3                        1
5            NA               NA                        0
6             1                1                        1
7             1                3                        1
8             1                1                        0
9            NA               NA                        0
10           NA               NA                        0
11           NA               NA                        0
12            1                3                        0
13           NA               NA                        0
   anki_details_step1_1___2 anki_details_step1_1___3 anki_details_step1_1___4
1                         0                        0                        0
2                         0                        1                        0
3                         1                        0                        0
4                         0                        0                        0
5                         0                        0                        0
6                         0                        0                        0
7                         0                        0                        0
8                         0                        1                        0
9                         0                        0                        0
10                        0                        0                        0
11                        0                        0                        0
12                        0                        1                        0
13                        0                        0                        0
   anki_details_step1_1___5 anki_details_step1_1___6 anki_details_step1_1___7
1                         0                        0                        0
2                         0                        1                        0
3                         0                        1                        0
4                         0                        1                        0
5                         0                        0                        0
6                         0                        0                        1
7                         1                        1                        0
8                         0                        0                        0
9                         0                        0                        0
10                        0                        0                        0
11                        0                        0                        0
12                        0                        1                        0
13                        0                        0                        0
   sketchy_step1_1 sketchy_details_step1_1___1 sketchy_details_step1_1___2
1               NA                           0                           0
2                1                           1                           1
3                1                           1                           1
4                1                           1                           1
5                1                           1                           1
6                1                           0                           1
7                1                           1                           1
8               NA                           0                           0
9               NA                           0                           0
10              NA                           0                           0
11               1                           0                           0
12               1                           1                           1
13              NA                           0                           0
   sketchy_details_step1_1___3 sketchy_details_step1_1___4
1                            0                           0
2                            0                           0
3                            0                           0
4                            0                           0
5                            0                           0
6                            0                           0
7                            0                           0
8                            0                           0
9                            0                           0
10                           0                           0
11                           0                           0
12                           0                           0
13                           0                           0
   sketchy_details_step1_1___5 sketchy_details_step1_1___6
1                            0                           0
2                            0                           1
3                            0                           0
4                            0                           0
5                            0                           0
6                            0                           0
7                            0                           1
8                            0                           0
9                            0                           0
10                           0                           0
11                           1                           0
12                           0                           1
13                           0                           0
   sketchy_details_step1_1___7 amboss_details_step1_1___1
1                            0                          0
2                            0                          0
3                            0                          0
4                            0                          0
5                            0                          0
6                            0                          0
7                            0                          0
8                            0                          0
9                            0                          0
10                           0                          0
11                           0                          0
12                           0                          0
13                           0                          0
   amboss_details_step1_1___2 amboss_details_step1_1___3 amboss_library_step1_1
1                           0                          0                     NA
2                           0                          0                     NA
3                           0                          0                     NA
4                           0                          0                     NA
5                           0                          0                     NA
6                           0                          0                     NA
7                           0                          0                     NA
8                           1                          0                      1
9                           0                          0                     NA
10                          0                          0                     NA
11                          0                          0                     NA
12                          0                          1                      1
13                          0                          0                     NA
   amboss_percent_step1_1 amboss_amount_step1_1 pathoma_step1_1 bnb_step1_1
1                      NA                    NA              NA          NA
2                      NA                    NA              NA          NA
3                      NA                    NA               1           1
4                      NA                    NA               1          NA
5                      NA                    NA              NA          NA
6                      NA                    NA              NA          NA
7                      NA                    NA              NA          NA
8                      NA                    NA              NA          NA
9                      NA                    NA              NA          NA
10                     NA                    NA              NA          NA
11                     NA                    NA              NA          NA
12                     32                     3               1           1
13                     NA                    NA              NA          NA
   bnb_how_step1_1___1 bnb_how_step1_1___2 bnb_how_step1_1___3
1                    0                   0                   0
2                    0                   0                   0
3                    1                   0                   0
4                    0                   0                   0
5                    0                   0                   0
6                    0                   0                   0
7                    0                   0                   0
8                    0                   0                   0
9                    0                   0                   0
10                   0                   0                   0
11                   0                   0                   0
12                   1                   0                   0
13                   0                   0                   0
   bnb_how_step1_1___4 length_step1_1 practicetest_step1_1
1                    0              4                    4
2                    0              3                    3
3                    0              6                    6
4                    0              4                    4
5                    0              3                    5
6                    0              6                    6
7                    0              6                    5
8                    0              4                    4
9                    0              4                    3
10                   0              4                    3
11                   0              3                    4
12                   0              5                    3
13                   0              5                    5
   practice_test_amount_step1_1 full_test_practice_step1_1 push_step1_1
1                             3                          2            1
2                             3                          1            1
3                             2                          4            1
4                             1                          3            1
5                             3                          1            1
6                             3                          3            1
7                             3                          4            1
8                             3                          3            1
9                             1                          3            1
10                            3                          1            1
11                            3                          4            1
12                            3                          3            1
13                            1                          1            1
   push_remember_step1_1 push_score_only_step1_1 push_practice_test_step1_1
1                      3                      NA                          4
2                      4                      NA                         NA
3                      4                      NA                         NA
4                      2                       1                         NA
5                      4                      NA                         NA
6                      4                      NA                         NA
7                      3                      NA                          3
8                      4                      NA                         NA
9                      2                       1                         NA
10                     4                      NA                         NA
11                     2                       1                         NA
12                     2                       1                         NA
13                     4                      NA                         NA
   push_nbme_practice_score_step1_1 push_uw_practice_score_step1_1
1                                65                             NA
2                                NA                             NA
3                                NA                             NA
4                                70                             NA
5                                NA                             NA
6                                NA                             NA
7                                80                             NA
8                                NA                             NA
9                                87                             NA
10                               NA                             NA
11                               83                             NA
12                               30                             NA
13                               NA                             NA
   final_practice_step1_1 final_practice_test_step1_1
1                       1                           6
2                       0                          NA
3                       0                          NA
4                       1                           7
5                       0                          NA
6                       0                          NA
7                       1                           2
8                       1                           7
9                       1                           7
10                      1                           6
11                      1                           5
12                      0                          NA
13                      0                          NA
   final_nbme_practice_score_step1_1 final_uw_practice_score_step1_1
1                                 68                              NA
2                                 NA                              NA
3                                 NA                              NA
4                                 95                              NA
5                                 NA                              NA
6                                 NA                              NA
7                                 97                              NA
8                                 97                              NA
9                                 98                              NA
10                                99                              NA
11                                92                              NA
12                                NA                              NA
13                                NA                              NA
   score_step1_1 retake_step1_1 retake_pass_step1_1 study_amount_step1_1
1              1             NA                  NA                    3
2              1             NA                  NA                    1
3              1             NA                  NA                    1
4              1             NA                  NA                    1
5              1             NA                  NA                    2
6              1             NA                  NA                    2
7              1             NA                  NA                    2
8              1             NA                  NA                    1
9              1             NA                  NA                    1
10             1             NA                  NA                    3
11             1             NA                  NA                    1
12             1             NA                  NA                    1
13             1             NA                  NA                    2
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  changes_step1_1
1                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                
2                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       Didn't know how to note this above, but I did step 1 anki for the entirety of my last clerkship then spent 2 weeks of dedicated studying 
3                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                
4                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                
5                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             I would have started reviewing material (i.e. watching B&B, Sketchy pharm) before dedicated started so that I could devote my dedicated time almost exclusively to UWorld questions
6                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           I ended up taking 12 weeks. M1 was terrible for me and I didn't know how to study. So, I would go back and study more for it during M1 or M2 but even 12 weeks was pushing it for me to make up the deficit I was in 
7                                                                                                                                                                                            I wish I would have started the premade anki deck during M1 instead of at the start of M2. I finished about 50% of STEP 1 cards and 75% of STEP 2 cards by the time I took Step 1 and I think it would have been much quicker to a passing score if i had a higher percentage of STEP 1 cards mastered. I did not use UWorld at all because I found that reviewing missed questions didn't help me at all. I never remembered the info or explanations unless I memorized it with anki first. Once I had things memorized, I had no issues applying the knowledge in exam form. The only questions I missed were ones that I had never seen on anki.
8                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              I wish it was after pre-clinical year and not after clinical year.
9                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         I wish we had completed step 1 post pre clerkship with dedicated time. 
10                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             I would focus on pathophysiology section of uworld
11 I wish I didn't listen to the advice/guidance that my school (HMS) gave me. They really emphasized use of First Aid and at first I followed their guidance (because they shared so little guidance/support overall) even though I have never been a textbook reader, and so I wasted a lot of time studying via methods that were not compatible with my learning style. I also wish I had the opportunity to study with peers or through an HMS class because I also learn much better by talking through concepts with others, but there were no classes/study groups/tutoring or really any support offered by HMS. Given how much we pay for tuition to HMS, I think we should be able to opt-in or sign up for a Step 1 prep course - at a minimum this would provide some structure to an otherwise isolating and irritating experience.
12                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               
13                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            Spent more time studying during pre-clinical years 
   step_1_first_complete step_2_first_timestamp resources_step2_1___1
1                      2                                            0
2                      2                                            0
3                      2                                            0
4                      2                                            0
5                      2                                            0
6                      2                                            0
7                      2                                            0
8                      2                                            0
9                      2                                            0
10                     2                                            0
11                     2                                            0
12                     2                                            0
13                     2                                            0
   resources_step2_1___2 resources_step2_1___3 resources_step2_1___4
1                      0                     0                     0
2                      0                     0                     0
3                      0                     0                     0
4                      0                     0                     0
5                      0                     0                     0
6                      0                     0                     0
7                      0                     0                     0
8                      0                     0                     0
9                      0                     0                     0
10                     0                     0                     0
11                     0                     0                     0
12                     0                     0                     0
13                     0                     0                     0
   resources_step2_1___5 resources_step2_1___6 resources_step2_1___7
1                      0                     0                     0
2                      0                     0                     0
3                      0                     0                     0
4                      0                     0                     0
5                      0                     0                     0
6                      0                     0                     0
7                      0                     0                     0
8                      0                     0                     0
9                      0                     0                     0
10                     0                     0                     0
11                     0                     0                     0
12                     0                     0                     0
13                     0                     0                     0
   resources_step2_1___8 other_resources_step2_1 other_step2_1
1                      0                                      
2                      0                                      
3                      0                                      
4                      0                                      
5                      0                                      
6                      0                                      
7                      0                                      
8                      0                                      
9                      0                                      
10                     0                                      
11                     0                    <NA>          <NA>
12                     0                    <NA>          <NA>
13                     0                    <NA>          <NA>
   uworld_percent_step2_1 uworld_step2_1 first_aid_step2_1 anki_step2_1
1                      NA             NA                NA           NA
2                      NA             NA                NA           NA
3                      NA             NA                NA           NA
4                      NA             NA                NA           NA
5                      NA             NA                NA           NA
6                      NA             NA                NA           NA
7                      NA             NA                NA           NA
8                      NA             NA                NA           NA
9                      NA             NA                NA           NA
10                     NA             NA                NA           NA
11                     NA             NA                NA           NA
12                     NA             NA                NA           NA
13                     NA             NA                NA           NA
   anki_use_step2_1 anki_details_step2_1___1 anki_details_step2_1___2
1                NA                        0                        0
2                NA                        0                        0
3                NA                        0                        0
4                NA                        0                        0
5                NA                        0                        0
6                NA                        0                        0
7                NA                        0                        0
8                NA                        0                        0
9                NA                        0                        0
10               NA                        0                        0
11               NA                        0                        0
12               NA                        0                        0
13               NA                        0                        0
   anki_details_step2_1___3 anki_details_step2_1___4 anki_details_step2_1___5
1                         0                        0                        0
2                         0                        0                        0
3                         0                        0                        0
4                         0                        0                        0
5                         0                        0                        0
6                         0                        0                        0
7                         0                        0                        0
8                         0                        0                        0
9                         0                        0                        0
10                        0                        0                        0
11                        0                        0                        0
12                        0                        0                        0
13                        0                        0                        0
   anki_details_step2_1___6 anki_details_step2_1___7 sketchy_step2_1
1                         0                        0              NA
2                         0                        0              NA
3                         0                        0              NA
4                         0                        0              NA
5                         0                        0              NA
6                         0                        0              NA
7                         0                        0              NA
8                         0                        0              NA
9                         0                        0              NA
10                        0                        0              NA
11                        0                        0              NA
12                        0                        0              NA
13                        0                        0              NA
   sketchy_details_step2_1___1 sketchy_details_step2_1___2
1                            0                           0
2                            0                           0
3                            0                           0
4                            0                           0
5                            0                           0
6                            0                           0
7                            0                           0
8                            0                           0
9                            0                           0
10                           0                           0
11                           0                           0
12                           0                           0
13                           0                           0
   sketchy_details_step2_1___3 sketchy_details_step2_1___4
1                            0                           0
2                            0                           0
3                            0                           0
4                            0                           0
5                            0                           0
6                            0                           0
7                            0                           0
8                            0                           0
9                            0                           0
10                           0                           0
11                           0                           0
12                           0                           0
13                           0                           0
   sketchy_details_step2_1___5 sketchy_details_step2_1___6
1                            0                           0
2                            0                           0
3                            0                           0
4                            0                           0
5                            0                           0
6                            0                           0
7                            0                           0
8                            0                           0
9                            0                           0
10                           0                           0
11                           0                           0
12                           0                           0
13                           0                           0
   sketchy_details_step2_1___7 amboss_details_step2_1___1
1                            0                          0
2                            0                          0
3                            0                          0
4                            0                          0
5                            0                          0
6                            0                          0
7                            0                          0
8                            0                          0
9                            0                          0
10                           0                          0
11                           0                          0
12                           0                          0
13                           0                          0
   amboss_details_step2_1___2 amboss_details_step2_1___3 amboss_library_step2_1
1                           0                          0                     NA
2                           0                          0                     NA
3                           0                          0                     NA
4                           0                          0                     NA
5                           0                          0                     NA
6                           0                          0                     NA
7                           0                          0                     NA
8                           0                          0                     NA
9                           0                          0                     NA
10                          0                          0                     NA
11                          0                          0                     NA
12                          0                          0                     NA
13                          0                          0                     NA
   amboss_percent_step2_1 amboss_amount_step2_1 pathoma_step2_1 bnb_step2_1
1                      NA                    NA              NA          NA
2                      NA                    NA              NA          NA
3                      NA                    NA              NA          NA
4                      NA                    NA              NA          NA
5                      NA                    NA              NA          NA
6                      NA                    NA              NA          NA
7                      NA                    NA              NA          NA
8                      NA                    NA              NA          NA
9                      NA                    NA              NA          NA
10                     NA                    NA              NA          NA
11                     NA                    NA              NA          NA
12                     NA                    NA              NA          NA
13                     NA                    NA              NA          NA
   bnb_how_step2_1___1 bnb_how_step2_1___2 bnb_how_step2_1___3
1                    0                   0                   0
2                    0                   0                   0
3                    0                   0                   0
4                    0                   0                   0
5                    0                   0                   0
6                    0                   0                   0
7                    0                   0                   0
8                    0                   0                   0
9                    0                   0                   0
10                   0                   0                   0
11                   0                   0                   0
12                   0                   0                   0
13                   0                   0                   0
   bnb_how_step2_1___4 length_step2_1 practicetest_step2_1
1                    0             NA                 <NA>
2                    0             NA                 <NA>
3                    0             NA                 <NA>
4                    0             NA                 <NA>
5                    0             NA                 <NA>
6                    0             NA                 <NA>
7                    0             NA                 <NA>
8                    0             NA                     
9                    0             NA                     
10                   0             NA                     
11                   0             NA                 <NA>
12                   0             NA                 <NA>
13                   0             NA                 <NA>
   practice_test_amount_step2_1 full_test_practice_step2_1
1                            NA                         NA
2                            NA                         NA
3                            NA                         NA
4                            NA                         NA
5                            NA                         NA
6                            NA                         NA
7                            NA                         NA
8                            NA                         NA
9                            NA                         NA
10                           NA                         NA
11                           NA                         NA
12                           NA                         NA
13                           NA                         NA
   final_practice_step2_1 practice_test_step2_1 practice_score_step2_1
1                      NA                    NA                     NA
2                      NA                    NA                     NA
3                      NA                    NA                     NA
4                      NA                    NA                     NA
5                      NA                    NA                     NA
6                      NA                    NA                     NA
7                      NA                    NA                     NA
8                      NA                    NA                     NA
9                      NA                    NA                     NA
10                     NA                    NA                     NA
11                     NA                    NA                     NA
12                     NA                    NA                     NA
13                     NA                    NA                     NA
   score_step2_1 retake_step2_1 retake_pass_step2_1 target_score_step2_1
1                            NA                  NA                   NA
2                            NA                  NA                   NA
3                            NA                  NA                   NA
4                            NA                  NA                   NA
5                            NA                  NA                   NA
6                            NA                  NA                   NA
7                            NA                  NA                   NA
8           <NA>             NA                  NA                   NA
9           <NA>             NA                  NA                   NA
10          <NA>             NA                  NA                   NA
11          <NA>             NA                  NA                   NA
12          <NA>             NA                  NA                   NA
13          <NA>             NA                  NA                   NA
   study_amount_step2_1 changes_step2_1 step_2_first_complete
1                    NA                                     0
2                    NA                                     0
3                    NA                                     0
4                    NA                                     0
5                    NA                                     0
6                    NA                                     0
7                    NA                                     0
8                    NA                                     0
9                    NA                                     0
10                   NA                                     0
11                   NA                                     0
12                   NA                                     0
13                   NA                                     0
   step_1_second_timestamp resources_step1_2___1 resources_step1_2___2
1                                              0                     0
2                                              0                     0
3                                              0                     0
4                                              0                     0
5                                              0                     0
6                                              0                     0
7                                              0                     0
8                                              0                     0
9                                              0                     0
10                                             0                     0
11                                             0                     0
12                                             0                     0
13                                             0                     0
   resources_step1_2___3 resources_step1_2___4 resources_step1_2___5
1                      0                     0                     0
2                      0                     0                     0
3                      0                     0                     0
4                      0                     0                     0
5                      0                     0                     0
6                      0                     0                     0
7                      0                     0                     0
8                      0                     0                     0
9                      0                     0                     0
10                     0                     0                     0
11                     0                     0                     0
12                     0                     0                     0
13                     0                     0                     0
   resources_step1_2___6 resources_step1_2___7 resources_step1_2___8
1                      0                     0                     0
2                      0                     0                     0
3                      0                     0                     0
4                      0                     0                     0
5                      0                     0                     0
6                      0                     0                     0
7                      0                     0                     0
8                      0                     0                     0
9                      0                     0                     0
10                     0                     0                     0
11                     0                     0                     0
12                     0                     0                     0
13                     0                     0                     0
   other_resources_step1_2 other_step1_2 uworld_percent_step1_2
1                     <NA>          <NA>                     NA
2                     <NA>          <NA>                     NA
3                     <NA>          <NA>                     NA
4                     <NA>          <NA>                     NA
5                     <NA>          <NA>                     NA
6                     <NA>          <NA>                     NA
7                     <NA>          <NA>                     NA
8                                                            NA
9                                                            NA
10                                                           NA
11                    <NA>          <NA>                     NA
12                    <NA>          <NA>                     NA
13                    <NA>          <NA>                     NA
   first_aid_step1_2 uworld_step1_2 anki_step1_2 anki_use_step1_2
1                 NA             NA           NA               NA
2                 NA             NA           NA               NA
3                 NA             NA           NA               NA
4                 NA             NA           NA               NA
5                 NA             NA           NA               NA
6                 NA             NA           NA               NA
7                 NA             NA           NA               NA
8                 NA             NA           NA               NA
9                 NA             NA           NA               NA
10                NA             NA           NA               NA
11                NA             NA           NA               NA
12                NA             NA           NA               NA
13                NA             NA           NA               NA
   anki_details_step1_2___1 anki_details_step1_2___2 anki_details_step1_2___3
1                         0                        0                        0
2                         0                        0                        0
3                         0                        0                        0
4                         0                        0                        0
5                         0                        0                        0
6                         0                        0                        0
7                         0                        0                        0
8                         0                        0                        0
9                         0                        0                        0
10                        0                        0                        0
11                        0                        0                        0
12                        0                        0                        0
13                        0                        0                        0
   anki_details_step1_2___4 anki_details_step1_2___5 anki_details_step1_2___6
1                         0                        0                        0
2                         0                        0                        0
3                         0                        0                        0
4                         0                        0                        0
5                         0                        0                        0
6                         0                        0                        0
7                         0                        0                        0
8                         0                        0                        0
9                         0                        0                        0
10                        0                        0                        0
11                        0                        0                        0
12                        0                        0                        0
13                        0                        0                        0
   anki_details_step1_2___7 anki_details_step1_2___8 sketchy_step1_2
1                         0                        0              NA
2                         0                        0              NA
3                         0                        0              NA
4                         0                        0              NA
5                         0                        0              NA
6                         0                        0              NA
7                         0                        0              NA
8                         0                        0              NA
9                         0                        0              NA
10                        0                        0              NA
11                        0                        0              NA
12                        0                        0              NA
13                        0                        0              NA
   sketchy_details_step1_2___1 sketchy_details_step1_2___2
1                            0                           0
2                            0                           0
3                            0                           0
4                            0                           0
5                            0                           0
6                            0                           0
7                            0                           0
8                            0                           0
9                            0                           0
10                           0                           0
11                           0                           0
12                           0                           0
13                           0                           0
   sketchy_details_step1_2___3 sketchy_details_step1_2___4
1                            0                           0
2                            0                           0
3                            0                           0
4                            0                           0
5                            0                           0
6                            0                           0
7                            0                           0
8                            0                           0
9                            0                           0
10                           0                           0
11                           0                           0
12                           0                           0
13                           0                           0
   sketchy_details_step1_2___5 sketchy_details_step1_2___6
1                            0                           0
2                            0                           0
3                            0                           0
4                            0                           0
5                            0                           0
6                            0                           0
7                            0                           0
8                            0                           0
9                            0                           0
10                           0                           0
11                           0                           0
12                           0                           0
13                           0                           0
   sketchy_details_step1_2___7 sketchy_details_step1_2___8
1                            0                           0
2                            0                           0
3                            0                           0
4                            0                           0
5                            0                           0
6                            0                           0
7                            0                           0
8                            0                           0
9                            0                           0
10                           0                           0
11                           0                           0
12                           0                           0
13                           0                           0
   amboss_details_step1_2___1 amboss_details_step1_2___2
1                           0                          0
2                           0                          0
3                           0                          0
4                           0                          0
5                           0                          0
6                           0                          0
7                           0                          0
8                           0                          0
9                           0                          0
10                          0                          0
11                          0                          0
12                          0                          0
13                          0                          0
   amboss_details_step1_2___3 amboss_library_step1_2 amboss_percent_step1_2
1                           0                     NA                     NA
2                           0                     NA                     NA
3                           0                     NA                     NA
4                           0                     NA                     NA
5                           0                     NA                     NA
6                           0                     NA                     NA
7                           0                     NA                     NA
8                           0                     NA                     NA
9                           0                     NA                     NA
10                          0                     NA                     NA
11                          0                     NA                     NA
12                          0                     NA                     NA
13                          0                     NA                     NA
   amboss_amount_step1_2 pathoma_step1_2 bnb_step1_2 bnb_how_step1_2___1
1                     NA              NA          NA                   0
2                     NA              NA          NA                   0
3                     NA              NA          NA                   0
4                     NA              NA          NA                   0
5                     NA              NA          NA                   0
6                     NA              NA          NA                   0
7                     NA              NA          NA                   0
8                     NA              NA          NA                   0
9                     NA              NA          NA                   0
10                    NA              NA          NA                   0
11                    NA              NA          NA                   0
12                    NA              NA          NA                   0
13                    NA              NA          NA                   0
   bnb_how_step1_2___2 bnb_how_step1_2___3 bnb_how_step1_2___4 length_step1_2
1                    0                   0                   0             NA
2                    0                   0                   0             NA
3                    0                   0                   0             NA
4                    0                   0                   0             NA
5                    0                   0                   0             NA
6                    0                   0                   0             NA
7                    0                   0                   0             NA
8                    0                   0                   0             NA
9                    0                   0                   0             NA
10                   0                   0                   0             NA
11                   0                   0                   0             NA
12                   0                   0                   0             NA
13                   0                   0                   0             NA
   practicetest_step1_2 practice_test_amount_step1_2 full_test_practice_step1_2
1                  <NA>                           NA                         NA
2                  <NA>                           NA                         NA
3                  <NA>                           NA                         NA
4                  <NA>                           NA                         NA
5                  <NA>                           NA                         NA
6                  <NA>                           NA                         NA
7                  <NA>                           NA                         NA
8                                                 NA                         NA
9                                                 NA                         NA
10                                                NA                         NA
11                 <NA>                           NA                         NA
12                 <NA>                           NA                         NA
13                 <NA>                           NA                         NA
   push_step1_2 push_remember_step1_2 push_score_only_step1_2
1            NA                    NA                      NA
2            NA                    NA                      NA
3            NA                    NA                      NA
4            NA                    NA                      NA
5            NA                    NA                      NA
6            NA                    NA                      NA
7            NA                    NA                      NA
8            NA                    NA                      NA
9            NA                    NA                      NA
10           NA                    NA                      NA
11           NA                    NA                      NA
12           NA                    NA                      NA
13           NA                    NA                      NA
   push_practice_test_step1_2 push_nbme_practice_score_step1_2
1                          NA                               NA
2                          NA                               NA
3                          NA                               NA
4                          NA                               NA
5                          NA                               NA
6                          NA                               NA
7                          NA                               NA
8                          NA                               NA
9                          NA                               NA
10                         NA                               NA
11                         NA                               NA
12                         NA                               NA
13                         NA                               NA
   push_uw_practice_score_step1_2 final_practice_step1_2
1                              NA                     NA
2                              NA                     NA
3                              NA                     NA
4                              NA                     NA
5                              NA                     NA
6                              NA                     NA
7                              NA                     NA
8                              NA                     NA
9                              NA                     NA
10                             NA                     NA
11                             NA                     NA
12                             NA                     NA
13                             NA                     NA
   final_practice_test_step1_2 final_nbme_practice_score_step1_2
1                           NA                                NA
2                           NA                                NA
3                           NA                                NA
4                           NA                                NA
5                           NA                                NA
6                           NA                                NA
7                           NA                                NA
8                           NA                                NA
9                           NA                                NA
10                          NA                                NA
11                          NA                                NA
12                          NA                                NA
13                          NA                                NA
   final_uw_practice_score_step1_2 score_step1_2 retake_step1_2
1                               NA            NA             NA
2                               NA            NA             NA
3                               NA            NA             NA
4                               NA            NA             NA
5                               NA            NA             NA
6                               NA            NA             NA
7                               NA            NA             NA
8                               NA            NA             NA
9                               NA            NA             NA
10                              NA            NA             NA
11                              NA            NA             NA
12                              NA            NA             NA
13                              NA            NA             NA
   retake_pass_step1_2 study_amount_step1_2 changes_step1_2
1                   NA                   NA                
2                   NA                   NA                
3                   NA                   NA                
4                   NA                   NA                
5                   NA                   NA                
6                   NA                   NA                
7                   NA                   NA                
8                   NA                   NA                
9                   NA                   NA                
10                  NA                   NA                
11                  NA                   NA            <NA>
12                  NA                   NA            <NA>
13                  NA                   NA            <NA>
   step_1_second_complete step_2_second_timestamp resources_step2_2___1
1                       0             2/8/23 9:35                     1
2                       0            2/8/23 10:12                     1
3                       0           2/16/23 20:15                     1
4                       0           2/20/23 13:01                     1
5                       0                                             0
6                       0                                             0
7                       0                                             0
8                       0                                             0
9                       0     2023-09-07 09:50:43                     1
10                      0     2023-09-07 16:06:06                     1
11                      0                                             0
12                      0     2023-10-04 08:42:48                     1
13                      0     2023-10-04 15:31:29                     1
   resources_step2_2___2 resources_step2_2___3 resources_step2_2___4
1                      1                     0                     0
2                      1                     0                     1
3                      0                     1                     0
4                      0                     1                     0
5                      0                     0                     0
6                      0                     0                     0
7                      0                     0                     0
8                      0                     0                     0
9                      0                     0                     0
10                     0                     0                     0
11                     0                     0                     0
12                     0                     1                     1
13                     0                     0                     0
   resources_step2_2___5 resources_step2_2___6 resources_step2_2___7
1                      0                     0                     0
2                      0                     0                     0
3                      0                     0                     0
4                      0                     0                     0
5                      0                     0                     0
6                      0                     0                     0
7                      0                     0                     0
8                      0                     0                     0
9                      0                     0                     0
10                     0                     0                     0
11                     0                     0                     0
12                     1                     1                     1
13                     0                     0                     0
   resources_step2_2___8
1                      0
2                      0
3                      0
4                      1
5                      0
6                      0
7                      0
8                      0
9                      0
10                     0
11                     0
12                     0
13                     1
                                      other_resources_step2_2 other_step2_2
1                                                                          
2                                                                          
3                                                                          
4                                Divine Intervention Podcasts           Yes
5                                                                          
6                                                                          
7                                                                          
8                                                                          
9                                                                          
10                                                                         
11                                                                         
12                                                                         
13 Summary PDFs/content review I found online, youtube videos           Yes
   uworld_percent_step2_2 uworld_step2_2 first_aid_step2_2 anki_step2_2
1                      70              1                 2           NA
2                      66              3                 1           NA
3                      65              1                NA            1
4                      80              1                NA            1
5                      NA             NA                NA           NA
6                      NA             NA                NA           NA
7                      NA             NA                NA           NA
8                      NA             NA                NA           NA
9                      50              1                NA           NA
10                     61              1                NA           NA
11                     NA             NA                NA           NA
12                     94              3                NA            1
13                     71              1                NA           NA
   anki_use_step2_2 anki_details_step2_2___1 anki_details_step2_2___2
1                NA                        0                        0
2                NA                        0                        0
3                 3                        0                        0
4                 3                        1                        0
5                NA                        0                        0
6                NA                        0                        0
7                NA                        0                        0
8                NA                        0                        0
9                NA                        0                        0
10               NA                        0                        0
11               NA                        0                        0
12                3                        0                        0
13               NA                        0                        0
   anki_details_step2_2___3 anki_details_step2_2___4 anki_details_step2_2___5
1                         0                        0                        0
2                         0                        0                        0
3                         1                        0                        0
4                         0                        0                        0
5                         0                        0                        0
6                         0                        0                        0
7                         0                        0                        0
8                         0                        0                        0
9                         0                        0                        0
10                        0                        0                        0
11                        0                        0                        0
12                        1                        0                        0
13                        0                        0                        0
   anki_details_step2_2___6 anki_details_step2_2___7 anki_details_step2_2___8
1                         0                        0                        0
2                         0                        0                        0
3                         0                        1                        0
4                         0                        0                        0
5                         0                        0                        0
6                         0                        0                        0
7                         0                        0                        0
8                         0                        0                        0
9                         0                        0                        0
10                        0                        0                        0
11                        0                        0                        0
12                        0                        1                        0
13                        0                        0                        0
   sketchy_step2_2 sketchy_details_step2_2___1 sketchy_details_step2_2___2
1               NA                           0                           0
2                1                           1                           0
3               NA                           0                           0
4               NA                           0                           0
5               NA                           0                           0
6               NA                           0                           0
7               NA                           0                           0
8               NA                           0                           0
9               NA                           0                           0
10              NA                           0                           0
11              NA                           0                           0
12               1                           0                           1
13              NA                           0                           0
   sketchy_details_step2_2___3 sketchy_details_step2_2___4
1                            0                           0
2                            0                           0
3                            0                           0
4                            0                           0
5                            0                           0
6                            0                           0
7                            0                           0
8                            0                           0
9                            0                           0
10                           0                           0
11                           0                           0
12                           1                           0
13                           0                           0
   sketchy_details_step2_2___5 sketchy_details_step2_2___6
1                            0                           0
2                            0                           0
3                            0                           0
4                            0                           0
5                            0                           0
6                            0                           0
7                            0                           0
8                            0                           0
9                            0                           0
10                           0                           0
11                           0                           0
12                           0                           0
13                           0                           0
   sketchy_details_step2_2___7 sketchy_details_step2_2___8
1                            0                           0
2                            0                           0
3                            0                           0
4                            0                           0
5                            0                           0
6                            0                           0
7                            0                           0
8                            0                           0
9                            0                           0
10                           0                           0
11                           0                           0
12                           1                           0
13                           0                           0
   amboss_details_step2_2___1 amboss_details_step2_2___2
1                           0                          0
2                           0                          0
3                           0                          0
4                           0                          0
5                           0                          0
6                           0                          0
7                           0                          0
8                           0                          0
9                           0                          0
10                          0                          0
11                          0                          0
12                          1                          1
13                          0                          0
   amboss_details_step2_2___3 amboss_library_step2_2 amboss_percent_step2_2
1                           0                     NA                     NA
2                           0                     NA                     NA
3                           0                     NA                     NA
4                           0                     NA                     NA
5                           0                     NA                     NA
6                           0                     NA                     NA
7                           0                     NA                     NA
8                           0                     NA                     NA
9                           0                     NA                     NA
10                          0                     NA                     NA
11                          0                     NA                     NA
12                          1                      1                     41
13                          0                     NA                     NA
   amboss_amount_step2_2 pathoma_step2_2 bnb_step2_2 bnb_how_step2_2___1
1                     NA              NA          NA                   0
2                     NA              NA          NA                   0
3                     NA              NA          NA                   0
4                     NA              NA          NA                   0
5                     NA              NA          NA                   0
6                     NA              NA          NA                   0
7                     NA              NA          NA                   0
8                     NA              NA          NA                   0
9                     NA              NA          NA                   0
10                    NA              NA          NA                   0
11                    NA              NA          NA                   0
12                     3               1           1                   1
13                    NA              NA          NA                   0
   bnb_how_step2_2___2 bnb_how_step2_2___3 bnb_how_step2_2___4 length_step2_2
1                    0                   0                   0              4
2                    0                   0                   0              3
3                    0                   0                   0              5
4                    0                   0                   0              5
5                    0                   0                   0             NA
6                    0                   0                   0             NA
7                    0                   0                   0             NA
8                    0                   0                   0             NA
9                    0                   0                   0              4
10                   0                   0                   0              4
11                   0                   0                   0             NA
12                   0                   0                   0              4
13                   0                   0                   0              4
   practicetest_step2_2 practice_test_amount_step2_2 full_test_practice_step2_2
1                     4                            1                          3
2                     3                            3                          4
3                     5                            2                          4
4                     4                            1                          3
5                                                 NA                         NA
6                                                 NA                         NA
7                                                 NA                         NA
8                  <NA>                           NA                         NA
9                     3                            1                          3
10                    3                            1                          1
11                 <NA>                           NA                         NA
12                    3                            3                          3
13                    5                            1                          1
   final_practice_step2_2 practice_test_step2_2 practice_score_step2_2
1                       0                    NA                       
2                       1                     7                    251
3                       1                     3                    243
4                       1                     7                    242
5                      NA                    NA                       
6                      NA                    NA                       
7                      NA                    NA                       
8                      NA                    NA                   <NA>
9                       0                    NA                   <NA>
10                      0                    NA                   <NA>
11                     NA                    NA                   <NA>
12                      0                    NA                   <NA>
13                      1                     5                    235
   score_step2_2 retake_step2_2 retake_pass_step2_2 target_score_step2_2
1            239             NA                  NA                    3
2            250             NA                  NA                    1
3   no score yet             NA                  NA                    1
4            244             NA                  NA                    1
5                            NA                  NA                   NA
6                            NA                  NA                   NA
7                            NA                  NA                   NA
8                            NA                  NA                   NA
9            n/a             NA                  NA                    1
10           253             NA                  NA                    1
11          <NA>             NA                  NA                   NA
12           266             NA                  NA                    2
13           230             NA                  NA                    3
   study_amount_step2_2
1                     2
2                     1
3                     2
4                     1
5                    NA
6                    NA
7                    NA
8                    NA
9                     1
10                    2
11                   NA
12                    1
13                    2
                                                                                                                                                                      changes_step2_2
1                                                                                                                                                                                    
2                                                                                                                                                                                    
3                                                                                                                                                                                    
4                                                                                                                                                                                    
5                                                                                                                                                                                    
6                                                                                                                                                                                    
7                                                                                                                                                                                    
8                                                                                                                                                                                    
9                                                                                             Dedicated time exclusive to step 2 post clerkship with step 1 completed pre-clerkship. 
10                                                                                                                                                                                   
11                                                                                                                                                                                   
12 Simulate a full day exam before taking the test. I had done half length practice tests leading up to it but found that I got fatigued on the test day for the last three sections.
13                                                                                               Studied more for Step 1. Would have done Anki in the months leading up to the exam. 
   step_2_second_complete  uniqueID
1                       2    VUSM 7
2                       2   VUSM 12
3                       2   VUSM 39
4                       2   VUSM 51
5                       0    VUSM 9
6                       0   VUSM 20
7                       0   VUSM 57
8                       0 UVASOM 12
9                       2 UVASOM 67
10                      2 UVASOM 79
11                      0    HMS 30
12                      2    HMS 55
13                      2    HMS 58
Code
step1_complete$push_practice_test_step1 <- factor(step1_complete$push_practice_test_step1, levels = c(1:8), labels = c("NBME 25", "NBME 26", "NBME 27", "NBME 28", "NBME 29", "NBME 30", "UWorld 1", "UWorld 2"))

units(step1_complete$push_uw_practice_score_step1) <- "score units"
units(step1_complete$push_nbme_practice_score_step1) <- "percent"
label(step1_complete$push_practice_test_step1) <- "exam that triggered pushing back"
label(step1_complete$push_nbme_practice_score_step1) <- "NBME P(passing) that triggered pushing back"
label(step1_complete$push_uw_practice_score_step1) <- "3 digit UWorld score that triggered pushing back"
caption <- "Description of indiviuals that pushed back Step 1"
table1(~ push_practice_test_step1 + push_uw_practice_score_step1 + push_nbme_practice_score_step1 |push_step1_label, data=step1_complete, topclass="Rtable1-zebra")
Yes
(N=62)
No
(N=475)
Overall
(N=537)
exam that triggered pushing back
NBME 25 0 (0%) 0 (0%) 0 (0%)
NBME 26 0 (0%) 0 (0%) 0 (0%)
NBME 27 3 (4.8%) 0 (0%) 3 (0.6%)
NBME 28 3 (4.8%) 0 (0%) 3 (0.6%)
NBME 29 0 (0%) 0 (0%) 0 (0%)
NBME 30 0 (0%) 0 (0%) 0 (0%)
UWorld 1 0 (0%) 0 (0%) 0 (0%)
UWorld 2 3 (4.8%) 0 (0%) 3 (0.6%)
Missing 53 (85.5%) 475 (100%) 528 (98.3%)
3 digit UWorld score that triggered pushing back (score units)
Mean (SD) 180 (0) NA (NA) 180 (0)
Median [Min, Max] 180 [180, 180] NA [NA, NA] 180 [180, 180]
Missing 59 (95.2%) 475 (100%) 534 (99.4%)
NBME P(passing) that triggered pushing back (percent)
Mean (SD) 67.3 (17.7) NA (NA) 67.3 (17.7)
Median [Min, Max] 70.0 [30.0, 87.0] NA [NA, NA] 70.0 [30.0, 87.0]
Missing 37 (59.7%) 475 (100%) 512 (95.3%)

Descriptive statistics will be reported by school and total.

  • histogram of Step 2 scores
  • what resources are most widely used barplot
  • how long did students study barplot
  • number of practice tests histogram (among the people who answered the question)
  • summarize comments (other_resources, other_step, changes_step)
Code
## do a plot for all schools (in total) as well as Vanderbilt in particular
## use a unified color scheme

ggplot(aes(x = score_step2), data= step2_complete) + geom_histogram() + theme_minimal() + xlab("Self Reported Step 2 Score") + ylab("Frequency") + labs(title = "Frequency of reported Step 2 Scores")
`stat_bin()` using `bins = 30`. Pick better value with `binwidth`.

Code
#more data cleaning first first step 2 for the resouces they selected that they used
resources_step2 <- colSums(took_step2general[20:35])
uworld <- resources_step2[1] + resources_step2[9]
first_aid <- resources_step2[2] + resources_step2[10]
anki <- resources_step2[3] + resources_step2[11]
sketchy <- resources_step2[4] +resources_step2[12]
amboss <- resources_step2[5] + resources_step2[13]
pathoma <- resources_step2[6] + resources_step2[14]
boards_and_beyond <- resources_step2[7] + resources_step2[15]
other <- resources_step2[8] + resources_step2[16]
totals <- c(uworld, first_aid, anki, sketchy, amboss, pathoma, boards_and_beyond, other)

#same idea for step 1
resources_step1 <- colSums(took_step1general[26:41])
uworld1 <- resources_step1[1] + resources_step1[9]
first_aid1 <- resources_step1[2] + resources_step1[10]
anki1 <- resources_step1[3] + resources_step1[11]
sketchy1 <- resources_step1[4] +resources_step1[12]
amboss1 <- resources_step1[5] + resources_step1[13]
pathoma1 <- resources_step1[6] + resources_step1[14]
boards_and_beyond1 <- resources_step1[7] + resources_step1[15]
other1 <- resources_step1[8] + resources_step1[16]
totals1 <- c(uworld1, first_aid1, anki1, sketchy1, amboss1, pathoma1, boards_and_beyond1, other1)

rdf <- data.frame(amount = c(totals, totals1), name = rep(names(totals), 2), step_exam = c(rep("Step 2", 8), rep("Step 1", 8) ))

# http://www.sthda.com/english/wiki/ggplot2-barplots-quick-start-guide-r-software-and-data-visualization used this as a guide

#what resources are most widely used? I want to sort this barplot in order of frequency but for some reason this wasn't working for me with reorder()
ggplot(data=rdf, aes(x=name, y=amount, fill = step_exam)) +
  geom_bar(stat="identity", position=position_dodge())+
  theme_minimal() + coord_flip() + scale_fill_brewer(palette="Blues")

Code
## how long did the students study barplot
       # for step 1
step1_complete$length_step1 <- factor(step1_complete$length_step1 , levels = c(1:6), labels = c("less than 1 week", "1-2 weeks", "3-4 weeks", "5-6 weeks", "7-8 weeks", "more than 8 weeks"))

ggplot(data.frame(step1_complete), aes(x=length_step1)) + geom_bar() + theme_minimal() + xlab("Time") + ylab("Frequency") + labs(title = "How long did you study for Step 1 during a protected study period?")

Code
       # for step 2

ggplot(data.frame(step2_complete), aes(x=length_step2)) + geom_bar() + theme_minimal() + xlab("Time") + ylab("Frequency") + labs(title = "How long did you study for Step 2 during a protected study period?")

Code
## number of practice tests histogram (among the people who answered the question)
ggplot(aes(x = number_of_practice_tests), data= step2_complete) + geom_histogram() + theme_minimal() + xlab("Number of tests") + ylab("Frequency") + labs(title = "How many total practice tests did you take before Step 2?")
`stat_bin()` using `bins = 30`. Pick better value with `binwidth`.
Warning: Removed 18 rows containing non-finite values (`stat_bin()`).

Code
ggplot(aes(x = practicetest_step1), data= step1_complete) + geom_histogram() + theme_minimal() + xlab("Number of tests") + ylab("Frequency") + labs(title = "How many total practice tests did you take before Step 1?")
`stat_bin()` using `bins = 30`. Pick better value with `binwidth`.
Warning: Removed 92 rows containing non-finite values (`stat_bin()`).

Code
## summarize comments (other_resources, other_step, changes_step)
#"other_resources_step1"           "other_step1"                     "changes_step1"   
kable(table(step1_complete$other_resources_step1), caption = "Other listed resources for Step 1")
Other listed resources for Step 1
Var1 Freq
348
Dirty Medicine 3
Dirty Medicine Videos 1
Dirty Medicine YouTube videos 3
NBME and Dr. Legallo's videos and notes from preclinical 2
nbme practice exams 2
NBME practice tests 3
Online MedEd 3
Osmosis 2
Pixorize 2
Youtube 3
Code
#If you used other resources not listed above, would you use them again?
step1_complete$other_hascontents <- as.integer(nchar(step1_complete$other_resources_step1) > 0) #flagging the rows that have contents https://stackoverflow.com/questions/64744988/testing-to-see-if-characters-are-present-in-a-cell-in-r
as_tibble(step1_complete[which(step1_complete$other_hascontents == 1), c("other_resources_step1", "other_step1") ])
# A tibble: 24 × 2
   other_resources_step1         other_step1                                    
   <chr>                         <chr>                                          
 1 nbme practice exams           yes                                            
 2 NBME practice tests           Yes                                            
 3 Youtube                       Yes                                            
 4 Online MedEd                  Maybe                                          
 5 Pixorize                      Yes, helped immensely with biochemistry and im…
 6 Dirty Medicine YouTube videos yes                                            
 7 Dirty Medicine                Yes                                            
 8 nbme practice exams           yes                                            
 9 NBME practice tests           Yes                                            
10 Youtube                       Yes                                            
# ℹ 14 more rows
Code
# what would you change?
step1_complete$change_hascontents <- as.integer(nchar(step1_complete$changes_step1) > 0) 
as_tibble(step1_complete[which(step1_complete$change_hascontents == 1), "changes_step1" ])
# A tibble: 114 × 1
   value                                                                        
   <chr>                                                                        
 1 "Just do UWorld and know First Aid well, that's all you really need."        
 2 "Didn't know how to note this above, but I did step 1 anki for the entirety …
 3 "Though I probably could have studied much less, I did not find the '% likel…
 4 "I would probably take the test after 2 weeks instead of 3"                  
 5 "I would have taken it immediately after ending clerkships and then gone off…
 6 "I took a practice test on Day 1 of studying, which I did not find helpful. …
 7 "None"                                                                       
 8 "If anything, maybe one less week. It can definitely be done in 4 weeks but …
 9 "I would have a shorter study period and focused more on step 2"             
10 "I would have switched to timed, untutored mode on U world sooner. On the re…
# ℹ 104 more rows
Code
#dat$study_amount_step1_1

3 Appendix/notes

All the analyses are performed using the following:

  • R version 4.2.2 (2022-06-24); R Core Team (2022). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. URL https://www.R-project.org/.

  • Harrell Jr FE (2022). rms: Regression Modeling Strategies. R package version 6.3-0, https://CRAN.R-project.org/package=rms.

The table below lists packages used in this document.

Code
subset(data.frame(sessioninfo::package_info()), attached==TRUE, c(package, loadedversion))
                  package loadedversion
cowplot           cowplot         1.1.1
dplyr               dplyr         1.1.3
forcats           forcats         1.0.0
GGally             GGally         2.1.2
ggplot2           ggplot2         3.4.4
gridExtra       gridExtra           2.3
Hmisc               Hmisc         5.1-1
knitr               knitr          1.44
lubridate       lubridate         1.9.3
modelsummary modelsummary         1.4.3
plotly             plotly        4.10.2
purrr               purrr         1.0.2
readr               readr         2.1.4
rms                   rms         6.7-1
sandwich         sandwich         3.0-2
scales             scales         1.2.1
stringr           stringr         1.5.0
table1             table1         1.4.3
tibble             tibble         3.2.1
tidyr               tidyr         1.3.0
tidyverse       tidyverse         2.0.0
viridis           viridis         0.6.4
viridisLite   viridisLite         0.4.2
visdat             visdat         0.6.0